Salary Prediction

Predict Salaries for Data Scientists using Regression

3-22-2022

Web Scraping

Imports

Define Functions

Go get the data from one page and clean it a bit to fit it into a dataframe

Make the dataframe

EDA and Data Normalization

Using the base_url, use selenium to go to the page, click on the "See full report" button to expand it out, and parse the results

Merge original and company rating dataframes

Make the salary data more even by removing outliers

Feature Engineering

Check for Multicollinearity

Method: Variance Inflation Factor (VIF)

Modeling

Linear Regression

Polynomial

LassoCV

Ridge